BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on ALL-TOTAL events by Ev. Decom. - Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[ALL-TOTAL]== 3520 ( 1755) 2716 ( 1755) 49.86 64.62 56.29
[JULIELab ] ==[ALL-TOTAL]== 3520 ( 1737) 3068 ( 1737) 49.35 56.62 52.73
[UT+DBCLS ] ==[ALL-TOTAL]== 3520 ( 1424) 2311 ( 1424) 40.45 61.62 48.84
[ConcordU ] ==[ALL-TOTAL]== 3520 ( 1340) 1991 ( 1340) 38.07 67.30 48.63
[VIBGhent ] ==[ALL-TOTAL]== 3520 ( 1224) 2089 ( 1224) 34.77 58.59 43.64
[ UTokyo ] ==[ALL-TOTAL]== 3520 ( 1042) 1793 ( 1042) 29.60 58.11 39.22
[ UNSW ] ==[ALL-TOTAL]== 3520 ( 1060) 1957 ( 1058) 30.11 54.06 38.68
[ UZurich ] ==[ALL-TOTAL]== 3520 ( 1027) 1852 ( 1027) 29.18 55.45 38.24
[ SCAI ] ==[ALL-TOTAL]== 3520 ( 958) 2312 ( 958) 27.22 41.44 32.85
[ Cam ] ==[ALL-TOTAL]== 3520 ( 771) 1199 ( 771) 21.90 64.30 32.68
[ASU+HU+BU] ==[ALL-TOTAL]== 3520 ( 745) 1106 ( 745) 21.16 67.36 32.21
[UAntwerp ] ==[ALL-TOTAL]== 3520 ( 821) 1584 ( 821) 23.32 51.83 32.17
[ Team 24 ] ==[ALL-TOTAL]== 3520 ( 811) 1749 ( 810) 23.04 46.31 30.77
[ UNIMAN ] ==[ALL-TOTAL]== 3520 ( 755) 1444 ( 755) 21.45 52.29 30.42
[ UAveiro ] ==[ALL-TOTAL]== 3520 ( 739) 1362 ( 739) 20.99 54.26 30.27
[ USzeged ] ==[ALL-TOTAL]== 3520 ( 747) 1852 ( 747) 21.22 40.33 27.81
[CNBMadrid] ==[ALL-TOTAL]== 3520 ( 1245) 5687 ( 1244) 35.37 21.87 27.03
[ NICTA ] ==[ALL-TOTAL]== 3520 ( 682) 1541 ( 682) 19.38 44.26 26.95
[ UMich ] ==[ALL-TOTAL]== 3520 ( 1263) 7560 ( 1263) 35.88 16.71 22.80
[CCP-BTMG ] ==[ALL-TOTAL]== 3520 ( 461) 606 ( 461) 13.10 76.07 22.35
[CIPS-ASU ] ==[ALL-TOTAL]== 3520 ( 784) 3825 ( 784) 22.27 20.50 21.35
[ PIKB ] ==[ALL-TOTAL]== 3520 ( 390) 552 ( 390) 11.08 70.65 19.16
[ Team 09 ] ==[ALL-TOTAL]== 3520 ( 433) 1233 ( 433) 12.30 35.12 18.22
[ KoreaU ] ==[ALL-TOTAL]== 3520 ( 332) 499 ( 332) 9.43 66.53 16.52
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[ALL-TOTAL]== 3716 ( 1487) 2398 ( 1487) 40.02 62.01 48.64
[ Team 24 ] ==[ALL-TOTAL]== 3716 ( 870) 1826 ( 869) 23.41 47.59 31.38
[UAntwerp ] ==[ALL-TOTAL]== 3716 ( 834) 1609 ( 834) 22.44 51.83 31.32
[ASU+HU+BU] ==[ALL-TOTAL]== 3716 ( 745) 1106 ( 745) 20.05 67.36 30.90
[CNBMadrid] ==[ALL-TOTAL]== 3716 ( 1343) 6696 ( 1342) 36.14 20.04 25.78
[CCP-BTMG ] ==[ALL-TOTAL]== 3716 ( 478) 623 ( 478) 12.86 76.73 22.03
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] ==[ALL-TOTAL]== 3941 ( 1408) 2127 ( 1408) 35.73 66.20 46.41
[VIBGhent ] ==[ALL-TOTAL]== 3941 ( 1266) 2251 ( 1266) 32.12 56.24 40.89
[ASU+HU+BU] ==[ALL-TOTAL]== 3941 ( 767) 1185 ( 767) 19.46 64.73 29.93
[ NICTA ] ==[ALL-TOTAL]== 3941 ( 702) 1611 ( 702) 17.81 43.58 25.29
[ USzeged ] ==[ALL-TOTAL]== 3941 ( 784) 3113 ( 784) 19.89 25.18 22.23
[CCP-BTMG ] ==[ALL-TOTAL]== 3941 ( 480) 787 ( 480) 12.18 60.99 20.30